PCT/US97/2002(^J 

^(^TENT COOPERATION 

09/530 524p5f- 



From the INTERNATIONAL BUREAU 



PCT 



INFORMATION CONCERNING ELECTED 
OFFICES NOTIFIED OF THEIR ELECTION 



(PCT Rule 61.3) 



Date of mailing (day/month/year) 
01 July 1999 (01.07.99) 



Applicant's or agent* s file reference 
31075-PCT 



To: 



TANG, Henry 
Baker & Botts, LLP 
30 Rockefeller Plaza 
New York, NY 10112-022§g JUL \ k 
ETATS-UNIS D'AMERIQUE 



RECEIVED 
BAKER & BOTTS. L.L.P. 



I ll: 22 




IMPORTANT INFORt 



International application No. 

PCT/US97/2002-1 


International filing date (day/month/year) 
04 November 1997 (04.11.97) 


Priority date (day/month/year) 


Applicant 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK et al 



1 . The applicant is hereby informed that the International Bureau has, according to Article 31 (7), notified each of the following 
Offices of its election: 

National :CA,US 

2. The following Offices have waived the requirement for the notification of their election; the notification will be sent to them 
by the International Bureau only upon their request: 

None 

3. The applicant is reminded that he must enter the "national phase" before the expiration of 30 months from the priority date 
before each of the Offices listed above. This must be done by paying the national fee(s) and furnishing , if prescribed, a 
translation of the international application (Article 39(1 )(a)), as well as, where applicable, by furnishing a translation of any 
annexes of the international preliminary examination report (Article 36(3)(b) and Rule 74.1). 

Some offices have fixed time limits expiring later than the above-mentioned time limit. For detailed information about the 
applicable time limits and the acts to be performed upon entry into the national phase before a particular Office, see Volume II 
of the PCT Applicant's Guide. 



Docketed 
f^/^/2000by 



The International Bureau of WIPO 
34, chemin des Colombettes 
1211 Geneva 20, Switzerland 


Authorized officer: 
F. 


Baechlerjj^^— 




Facsimile No. (41-22) 740.14.35 


Telephone No. (4i^ 


f5f33&#£38 (\ 
^ ^ J 





Form PCT/IB/332 (September 1997) 



CM 



#TENT COOPERATION TREjfcv 



PCT/US97/20024 



From the INTERNATIONAL BUREAU 



PCT 

NOTIFICATION OF ELECTION 

(PCT Rule 61 .2) 



To: 



United States Patent and Trademark 

Office 

(Box PCT) 

Crystal Plaza 2 

Washington, DC 20231 

ETATS-UNIS D'AMERIQUE 



Date of mailing (day/mo nth/year) 
01 July 1999 (01.07.99) 


in its capacity as elected Office 




International application No. 
PCT/US97/20024 


Applicant's or agent* s file reference 
31075-PCT 


International filing date (day/month/year) 

04 November 1997 (04.11.97) 


Priority date (day/month/year) 


Applicant 

CHANG, Shih-Fu et al 



1. The designated Office is hereby notified of its election made: 

| X | in the demand filed with the International Preliminary Examining Authority on: 
02 June 1999 (02.06.99) 



| | in a notice effecting later election filed with the International Bureau on: 



2. The election | X| 

□ 



was not 



made before the expiration of 19 months from the priority date or, where Rule 32 applies, within the time limit under 
Rule 32.2(b). 



The International Bureau of WIPO 


Authorized officer 


34, chemin des Colombettes 


F. Baechler 


1211 Geneva 20, Switzerland 


Facsimile No.: (41-22) 740.14.35 


Telephone No.: (41-22) 338.83.38 



Form PCT/IB/331 (July 1992) 



2707375 



# 



PATENT COOPERATION TREATY 



0 9/53 0 52 



From the 

INTERNATIONAL PRELIMINARY EXAMINING AUTHORITY 



To: HENRY TANG 

BAKER & BOTTS, LLP 
30 ROCKEFELLER PLAZA 
NEW YORK, NY 10112-0228 



PCT 



WRITTEN OPINION ! . - 

(PCT Rule 66) 




Applicant's or agent's file reference 
31075-PCT 



Date of Mailing 
(day/ month /jear) 



2 0 DEC 1999 



REPLY DUE 



within TWO months 

from the above date of mailing 



International application No. 
PCT/US97/20024 



International filing date (day/ month /jear) 
04 NOVEMBER 1997 



Priority date (day /month /year) 
NONE 



International Patent Classification (IPC) or both national classification and IPC 
IPC(6): G06K 9/00 and US CI.: 382/115, 118, 165, 282, 283; 348/14, 19, 652 



Applicant 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK 



1. This written opinion is the 



first 



(first, etc.) drawn by this International Preliminary Examining Authority. 



2. This opinion contains indications relating to the following items: 



Non-establishment of opinion with regard to novelty, inventive step or industrial applicability 



Reasoned statement under Rule 66.2(a)(ii) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 



I 


[3 


II 


□ 


III 


□ 


IV 


□ 


V 




VI 


□ 


VII 


□ 


VIII 


□ 



Certain documents cited 



Docketed 
For 2 lC?Q /2000 B 



3. The applicant is hereby invited to reply to this opinion. 

When? See the time limit indicated above. The appli c ant may> boforo tho e xpiration of that timo limit, requoot thio 

Authority to grant an a xtonoion i » o m* Rul e 66 « 3(d) . 

By submitting a written reply, accompanied, where appropriate, by amendments, according to Rule 66.3. 
For the form and the language of the amendments, see Rules 66.8 and 66.9. 

For an additional opportunity to submit amendments, see Rule 66.4. 

For the examiner's obligation to consider amendments and/or arguments, see Rule 66.4 bis. 
For an informal communication with the examiner, see Rule 66.6. 
If no reply is filed, the international preliminary examination report will be established on the basis of this opinion. 

4. The final date by which the international preliminary wadpu onnn 



How? 
Also 





Name and mailing address of the I PEA/US 
Commissioner of Patents ind Trademarks 
Box PCT 

Washington, D.C 20231 
Facsimile No. (703) 305-3230 


AuO^edj^cer 
^fCHRIS KELLEY 
Telephone No. (703) 305-3900 



Form PCT/IPEA/408 (cover sheet) (January 1994)* 



REQUEST 



The undersigned requests that the present 

international application be processed 
according to the Patent Cooperation Treaty. 



receiving Office use only 



International Applicati 



«*/ S3 0 52 4 

ion No. 



International Filing Date 



Name of receiving Office and "PCT International Application" 



Applicant's or agent's file reference 31 075-PCT 
(if desired) (12 characters maximum) 



Name and address: (Family name followed by given name: for a legal entity, full official designation 
The address must include postal code and name of country. The country of the address indicated in this 
Box is the applicant's State (i.e. country) of residence if no State of residence is indicated below.) 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK 
1 1 6th Street and Broadway 
New York, NY 10027 
US 



State (i.e. country) of nationality: 
US 


State (i.e. country) of residence: 
US 


This person is applicant I — I all designated R7| all designated States except f "I the United States I I the States indicated in 
iAr t^^l^nf' I I States l& the United States of America I — I of America only I — I the Supplemental Box 


Box No. ID FURTHER APPLICANT(S) AND/OR (FURTHER) INVENTOR(S) 





Box No. I TITLE OF INVENTION 
VIDEO SIGNAL FACE REGION DETECTION 



Box No. II 



APPLICANT 



| | This person is also inventor. 



Telephone No. 



Facsimile No. 



Teleprinter No. 



Name and address: (Family name followed by given name; for a legal entity, full official designation 
The address must include postal code and name of country. The country of the address indicated in this 
Box is the applicants State (i.e. country) of residence if no State of residence is indicated below.) 

CHANG, SHIH-FU 
560 Riverside Drive, Apt. 18K 
New York, NY 10027 
US 



This person is: 

| | applicant only 

applicant and inventor 



| | inventor only (If this check-box 
is marked, do not fill in below.) 



State (i.e. country) of nationality: 
TW 


State (i.e. country) of residence: 
US 


This person is applicant I — I all designated I I all designated States except R7| the United States ( I the States indicated in 
f«" ti£ niimnw :of- I I States I I the United States of America of America only I — I the Supplemental Box 


Further applicants and/or (further) inventors are indicated on 


a continuation sheet. 




Box No. IV AGENT OR COMMON REPRESENTATIVE; OR ADDRESS FOR CORRESPONDENCE 


The person identified below is hereby/has been appointed to act on behalf R71 
of the applicant(s) before the competent International Authorities as: 1^1 


gent | | common representative 



designation. The address must include postal code and name of country.) 

TANG, Henry; RAYMOND, Dana M.; and MAUNE, James J. 

Baker & Botts, LLP 

30 Rockefeller Plaza 

New York. NY 10112-0228 

US 



(212) 705-5000 



Facsimile No. 
(212) 705-5020 



Teleprinter No. 



□ 



Mark this check-box where no agent or common representative is/has been appointed and the space above is used instead to 
indicate a special address to which correspondence should be sent. 



Form PCT/RO/101 (first sheet) (January 1997; reprint July 1997^ 



LegalSlar 1997. Form PCTREO 



See Notes to the request form 



Sheet No. 



Continuation of Box No. Ill FURTHER APPLICANTS AND/OR (FURTHER) INVENTORS 


If none of the following sub-boxes is used, this sheet is not to be included in the request 


■ 

Name and address: (Family name followed by given name; for a legal entity, full official designation 
The address must include postal code and name of country. The country of the address indicated in this 
Box is the applicants State (i.e. country) of residence if no State of residence is indicated below.) 

WANG, HUALU 

528 Riverside Drive, Apt. 5A 

New York, NY 10027 

US 


This person is: 

| I applicant only 

I XI applicant and inventor 

I | inventor onlv (If this check-box 
is marked, do not fill in below.) 


State (Le. country) of nationality: 
CN 


State (i.e. country) of residence: 
US 


This person is applicant I I all designated I I all designated States except EJ71 the United States I I the States indicated in 
for the purposes of: I I States I I the United States of America ICSJ of America only I — I the Supplemental Box 


Name and address : (Family name followed by given name; for a legal entity, full official designation 
The address must include postal code and name of country. The country of the address indicated in this 
Box is the applicants State (Le. country) of residence if no State of residence is indicated below.) 


This person is: 

| | applicant only 

| [ applicant and inventor 

| | inventor onlv (If this check-box 
is marked, do not fill in below.) 


State (i.e. country) of nationality: 


State (Le. country) of residence: 


This person is applicant I I all designated I I all designated States except I I the United States I | the States indicated in 
for the purposes of: I— I States I I the United States of America I — I of America only I — I the Supplemental Box 


Name and address: (Family name followed by given name; for a legal entity, full official designation 
The address must include postal code and name of country. The country of the address indicated in this 
Box is the applicants State (i.e. country) of residence if no State of residence is indicated below.) 


This person is: 

| | applicant only 

| | applicant and inventor 

| | inventor onlv (If this check-box 
is marked, do not fill in below.) 


State (i.e. country) of nationality: 


State (i.e. country) of residence: 


This person is applicant I I all designated I I all designated States except I I the United States \~ I the States indicated in 
for the purposes of: I I States I I the United States of America I I of America only I — I the Supplemental Box 


Name and address: (Family name followed by given name; for a legal entity, full official designation 
The address must include postal code and name of country. The country of the address indicated in this 
Box is the applicant's State (i.e. country) of residence if no State of residence is indicated below.) 


This person is: 

| | applicant only 

| | applicant and inventor 

l I inventor onlv (If this check-box 
is marked, do not fill in below.) 


State (i.e. country) of nationality: 


State (Le. country) of residence: 


This person is applicant I I all designated | I all designated States except I I the United States I I the States indicated in 
for the purposes of: I I States I I the United States of America I I of America only I I the Supplemental Box 


| | Further applicants and/or (further) inventors are indicated on another continuation sheet- 



FormPCT/RO/101 (continuation sheet) (January 1997; reprint July 1997) Legaistar 1 997. Form pctreq See Notes to the request form 



Sheet No. . . .3. 



Box No.V 



DESIGNATION OF STATES 



The following designations are hereby made undeT Rule 4.9(a) (mark the applicable check-boxes; at least one must be marked): 
Regional Patent 

UG Uganda, 



□ 
□ 

□ 
□ 



AP ARIPO Patent: GH Ghana, KE Kenya, LS Lesotho, MW Malawi, SD Sudan, SZ Swaziland, 
ZW Zimbabwe, and any other State which is a Contracting State of the Harare Protocol and of the PCT 

EA Eurasian Patent: AM Armenia, AZ Azerbaijan, BY Belarus, KG Kyrgyzstan, KZ Kazakstan, MD Republic of 
Moldova, RU Russian Federation, TJ Tajikistan, TM Turkmenistan, and any other State which is a Contracting State of 
the Eurasian Patent Convention and of the PCT 

EP European Patent: AT Austria, BE Belgium, CH and LI Switzerland and Liechtenstein, DE Germany, DK Denmark ES 
Spain, FI Finland, FR France, GB United Kingdom, GR Greece, IE Ireland, IT Italy, LU Luxembourg, MC 
Monaco, NL Netherlands, PT Portugal, SE Sweden, and any other State which is a Contracting State of the European 
Patent Convention and of the PCT 

OA OAPI Patent: BF Burkina Faso, BJ Benin, CF Central African Republic, CG Congo, CI Cote d'lvoire, CM Cameroon 
GA Gabon, GN Guinea, ML Mali, MR Mauritania, NE Niger, SN Senegal, TD Chad, TG Togo, and any other State 
which is a member State of OAPI and a Contracting State of the PCT (if other kind of protection or treatment desired, 
specify on dotted line) 



National Patent (if other kind of protection or treatment desired, specify on dotted line): 



□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 

□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 

□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 



AL Albania 

AM Armenia 

AT Austria 

AU Australia 

AZ Azerbaijan 

BA Bosnia and Herzegovina 

BB Barbados 

BG Bulgaria 

BR Brazil 

BY Belarus 

CA Canada 

CH and LI Switzerland and Liechtenstein 

CN China 

CU Cuba 

CZ Czech Republic 

DE Germany 

DK Denmark 

EE Estonia 

ES Spain 

FI Finland 

GB United Kingdom 

GE Georgia 

GH Ghana 

HU Hungary 

IL Israel 

IS Iceland 

JP Japan 

KE Kenya 

KG Kyrgyzstan 

KP Democratic People's Republic of Korea 



□ LV Latvia 

□ MD Republic of Moldova 

MG Madagascar 

MK The former Yugoslav Republic of Macedonia 

□ MN Mongolia 

□ MW Malawi 

□ MX Mexico 

□ NO Norway 

□ NZ New Zealand 

□ PL Poland 

□ PT Portugal 

□ RO Romania 

□ RU Russian Federation 

□ SD Sudan 

□ SE Sweden 
n SG Singapore 

□ SI Slovenia 

□ SK Slovakia 

□ SL Sierra Leone 

□ TJ Tajikistan 

□ TM Turkmenistan 

□ TR Turkey 

□ TT Trinidad and Tobago 

□ UA Ukraine 

□ UG Uganda 

US United States of America 



UZ 
VN 
YU 



Uzbekistan 
Viet Nam 
Yugoslavia 



KR 

KZ 

LC 

LK 

LR 

LS 

LT 

LU 



Republic of Korea 

Kazakstan 

Saint Lucia 
Sri Lanka 
Liberia 

Lesotho 

Lithuania 
Luxembourg .... 



□ 
□ 
□ 

□ ZW Zimbabwe 
Check-boxes reserved for designating States (for the purposes of 
a national patent) which have become party to the PCT after 
issuance of this sheet: 

□ 

□ 

□ 

□ 

□ 



In addition to the designations made above, die applicant also makes under Rule 4.9(b) all designations which would be permitted 

under the PCT except the designation(s) of 4 Iie 

applicant declares that those additional designations are subject to confirmation and that any designation which is not confirmed 
before the expiration of 15 months from the priority date is to be regarded as withdrawn by the applicant at the expiration of that time 

I limit. (Confirmation of a designation consists of the filing of a notice specifying that designation and the payment of the designation and 
confirmation fees. Confirmation must reach the receding Office within the f 5-month time limit.) 



Form PCT/RO/101 (second sheet) (July 1997) 



LegaiStar 1997. Form PCTREQ 



See Notes to the request form 
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Sheet No 


« m 




Box No. VI PRIORITY CLAIM 


Further priority claims are indicated in the Supplemental Box | | 


The priority of the following e 


arlier application(s) is hereby claimed: 


Country 
(in which, or for which, the 
application was filed) 


Filing Date 
(day/month/year) 


Application No. 


Office of filing 
(only for regional or 
international application) 


item(l) 


( 


) 






item (2) 


( 


) 






item (3) 




( 


) 






Mark tnejollowing check-box ij the certified copy of the earlier application is to be issued by the Office 
present international application is the receiving Office (a fee may be required): 
1 I The receiving Office is hereby requested to prepare and transmit to the International 
1 1 Bureau a certified copy of the earlier application(s) identified above as item(s): 


which for the purposes of the 


Box No. VII INTERNATIONAL SEARCHING AUTHORITY 


Choke of International Searching Authority (ISA) (If ^ or more InternationQ i Searching Authorities T „ A , 
are competent to carry out the international search, indicate the Authority chosen; the two-letter code mav be used): ISA/US 

Earlier search Fill in where a search (international, international-type or other) by the International Searching Authority has already been 
out or requested and the Authority is now requested to base the international search, to the extent possible, on the results of that earlier search 
such search or request either by reference to the relevant application (or the translation thereof) or by reference to the search request- 
Country (or regional Office): Date (day/month/year): Number: 


Box No. VIII CHECK LIST 


This international application contains 
the following number of sheets: 

1. request 4 sheets 

2. description : 24 sheets 

3. claims 3 sheets 

4. abstract 1 sheets 

5. drawings 12 sheets 

Total : 44 sheets 


This international aoplication is accompanied by the item(s) marked below: 
L CU po^fofattomey 5 * ^e calculation sheet 

2. I I copy of general 6 I | separate indications concerning 
1 — 1 power of attorney 1 — 1 deposited microorganisms 

3 1 1 statement explaining 7 1 1 nucleotide and/or amino acid 
1 — 1 lack of signature * 1 — 1 sequence listing (diskette) 

as item(s): 


Figure No. of the drawings (if any) should accompany the abstract when it is published. 


Box No. DC SIGNATURE OF APPLICANT OR AGENT 


XfJu^from r^^k^S^ nam€ ° fthe P erson si ^ in S ^d the capacity in which the person signs (if such capacity is not 
















/ James^vT/Maune (Agent) 





1 . Date of actual receipt of the purported 
international application: 


2. Drawings 
| | received: 

| | not received: 


3. Corrected date of actual receiDt due to later but 
timely received papers or drawings completing the 
purported international application: 


4. Date of timely receipt of the required 
corrections under PCT Article 1 1(2): 


5. International Searching Authority TC A . 
specified by the applicant: loA/ 


6. 1 I Transmittal of search copy delayed 
«— J until search fee is paid 






Date of receipt of the record copy 
by the International Bureau: 



Form PCT/RO/101 (last sheet) (January 1994; reprint July 1997) Legos* 1997. Form pctreo See Notes to the request fo 



The demand must be filed directly wilfr^^J competent International Preliminary Examining ^^f'ity or, if two or more Authorities are 
with the one chosen by the applicant. The full name or two-letter code of that Authority may be indicated by the applicant on the line 

1PEA/ US 



nay be 

09/530524 



PCT 

DEMAND 

under Article 3 1 of the Patent Cooperation Treaty: 
The undersigned requests that the international application specified below be the subject of 
international preliminary examination according to the Patent Cooperation Treaty and 
hereby elects all eligible States (except where otherwise indicated). 



CHAPTER II 



Identification of IPEA 



For International Preliminary Examining Authority use only 

Date of receipt of DEMAND 



Box No. I IDENTIFICATION OF THE INTERNATIONAL APPLICATION 


Applicant's or agent's file reference 
31075-PCT 


International application No. 
PCT/US97/20024 


International filing date (day/month/year) 
04 November 1997 ( 04.11.97 ) 


(Earliest) Priority date (day/month/year) 

( ) 


Title of invention 

VIDEO SIGNAL FACE REGION DETECTION 


Box No. II APPLICANT(S) 


Name and address: (Family name followed by given name; for a legal entity, full official 
designation. The address must include postal code and name of country.) 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK 
116th Street and Broadway 
New York, NY 10027 
US 


Telephone No.: 


Facsimile No.: 


Teleprinter No.: 


State (that is, country) of nationality: State (that is, country) of residence: 
US US 



Name and address: (Family name followed by given name; for a legal entity, full official designation. The address must include postal code and 
name of country,) 



CHANG, SHIH-FU 

560 Riverside Drive, Apt. 18K 

New York, NY 10027 

US 



State (that is, country) of nationality: 


State (that is, country) of residence: 


TW 


US 



Name and address: (Family name followed by given name; for a legal entity, full official designation. The address must include postal code and 
name of country.) 



WANG. HUALU 

528 Riverside Drive, Apt. 5A 

New York, NY 10027 

US 



State (that is, country) of nationality: 
CN 



State (that is, country) of residence: 
US 



[ | Further applicants are indicated on a continuation sheet 



Form PCT/1PEA/401 (first sheet) (July 1998) 



Legaister 1998, Form pctdem See Notes to the demand form 



Sheet No. .?. 


International application No. 

PCT/US97/20024 


Box No. Ill AGENT OR COMMON REPRESENTATIVE; OR ADDRESS FOR CORRESPONDENCE 


The following person is 1X1 agent 1 1 common representative 

and 1X1 has been appointed earlier and represents the applicant(s) also for international preliminary examination. 

1 1 j s hereby appointed and any earlier appointment of (an) agent(s) /common representative is hereby revoked. 

| — | is hereby appointed, specifically for the procedure before the International Preliminary Examining Authority, in 
' 1 addition to the apent(s)/common representative appointed earlier. 


Name and address: (Family name followed by given name; for a legal entity, full official 
The address must include postal code and name of country.) 

TANG, HENRY and 

MAUNE, JAMES J. 

Baker & Botts, LLP 

30 Rockefeller Plaza 

New York, NY 10112-0228 

US 


Telephone No.: 
(212) 705-5000 


Facsimile No.: 
(212) 705-5020 


Teleprinter No.: 



□ Address for correspondence: Mark this check-box where no agent or common representative is/has been appointed and 
the space above is used instead to indicate a special address to which correspondence should be sent. 



Box No. IV BASIS FOR INTERNA T J ON A L PRELIMINARY EXAMINATION 



Statement concerning amendments:* 

1 . The applicant wishes the international preliminary examination to start on the basis of: 
I XI the international application as originally filed. 

the description | I as originally filed 

| | as amended under Article 34 

the claims [Z2 as originally filed 

| | as amended under Article 19 (together with any accompanying statement) 
I | as amended under Article 34 

the drawings I I as originally filed 

| | as amended under Article 34 

2. | | The applicant wishes any amendment to the claims under Article 19 to be considered as reversed. 

3. 1 | The applicant wishes the start of the international preliminary examination to be postponed until the expiration of 

20 months from the priority date unless the International Preliminary Examing Authority receives a copy of any 
amendments made under Article 19 or a notice from the applicant that he does not wish to make such amendments 
(Rule 69.1(d)). (This check-box may be marked only where the time limit under Article 19 has not yet expired) 
* Where no check-box is marked, international preliminary examination will start on the basis of the international application as 
originally filed or, where a copy of amendments to the claims under Article 19 and/or amendments of the international 
application under Article 34 are received by the International Preliminary Examining Authority before it has begun to draw up 
a written opinion or the international preliminary examination report, as so amended. 



Language for the purposes of international preliminary examination: English 
PQ which is the language in which the international application was filed. 
I | which is the language of a translation furnished for the purposes of international search. 
1 | which is the language of publication of the international application. 

I | which is the language of the translation (to be) furnished for the purposes of international preliminary examination. 



Box No. V ELECTION OF STATES 



The applicant hereby elects all eligible States (that is. ail States which have been designated and which are bound by Chapter II of the 
PCT) 

excluding the following States which the applicant wishes not to elect: 



Form PCT/IPEA/401 (second sheet) (July 1998) Legaistar 1998. Form pctdem &e Nofes %Q ghe demand form 



% 



Sheet No. 



International application No. 

PCT/US97/20024 



Box No. VI CHECK LIST 



The demand is accompanied by the following elements, in the language referred to in 
Box No. IV, for the purposes of international preliminary examination: 

1. translation of international application 

2. amendments under Article 34 

3 copy (or where required, translation) 

of amendments under Article 19 : 



4. copy (or, where required, translation) 
of statement under Article 1 9 



5. letter 

6. other (specify) 



For International Preliminary 
Examining Authority use only 



sheets 


received 

□ 


not received 

□ 


sheets 


□ 


□ 


sheets 


□ 


□ 


sheets 


□ 


□ 


sheets 


□ 


□ 


sheets 


□ 


□ 



The demand is also accompanied by the item(s) marked below: 

1. ^| fee calculation sheet 

2. | | separate signed power of attorney 

3 I I copy of general power of attorney; 
I — I reference number, if any: 



4. | | statement explaining lack of signature 

5 I I nucleotide and or amino acid sequence listing in 

I — I computer readable form 

6. [^| other (specify): Transmittal Letter 



Box No. VII SIGNATURE OF APPLICANT, AGENT OR COMMON REPRESENTATIVE 



Next to each signature, indicate the name of the person signing and the capacity in which the person signs (if such capacity is not 
obvious from reading the demand). 




1. Date of actual receipt df-BEMAND; 



r IntemationafPreliminary Examining Authority use only 



2 Adjusted date of receipt of demand due 
to CORRECTIONS under Rule 60.1(b): 



3. I — I The date of receipt of the demand is AFTER the expiration of 19 months 
I — I from the priority date and item 4 or 5, below, does not apply. 



□ The applicant has been 
informed accordingly. 



4 I — I The date of receipt of the demand is WITHIN the period of 1 9 months from the priority date as extended by virtue of 
I — I Rule 80.5. 



5 I — I Although the date of receipt of the demand is after the expiration of 19 months from the priority date, the delay in arrival is 
I — I EXCUSED pursuant to Rule 82. 



For International Bureau use only 



Demand received from IPEA on: 



Form PCT/IPEA/401 (last sheet) (July 1998) 



ugaistar 1998. Form pctdem See Notes to the demand form 
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CHAPTER II 



FEE CALCULATION SHEET 
Annex to the Demand for international preliminary examination 

" For International Preliminary Examining Authority use only 



International 
application No. 


PCT/US97/20024 


Applicant's or agent's 
file reference 


31075-PCT 



Date stamp of the IPEA 



Applicant 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK 



Calculation of prescribed fees 



1. Preliminary examination fee 

2. Handling fee (Applicants from certain States are 
entitled to a reduction of 75% of the handling fee. 
Where the applicant is for all applicants are) so 
entitled, the amount to be entered at H is 25% of the 
handling fee.) 

3. Total of prescribed fees 

Add the amounts entered at P and H 

and enter total in the TOTAL box 



490.00 



162.00 H 



652.00 



TOTAL 



Mode of Payment 



□ authorization to charge deposit 
account with the IPEA (see below) 



cheque 
| | postal money order 
| | bank draft 



| | cash 

| | revenue stamps 

| | coupons 

| | other (specify): 



Deposit Account Authorization (this mode of payment may not be available at all IPEAs) 

The IPEA/ US j j is hereby authorized to charge the total fees indicated above to my deposit account. 



(this check-box may be marked only if the conditions for deposit accounts of the IPEA so permit) is 
hereby authorized to charge any deficiency or credit any overpayment in the total fees indicated 




Form PCT/IPEA/401 (Annex) (July 1998) 



See Notes to the fee calculation sheet 



NT COOPERATION TRE 



From the 

INTERNATIONAL PRELIMINARY EXAMINING AUTHORITY 



Ta 



HENRY TANG 
BAKER & BOTTS, LLP 
30 ROCKEFELLER PLAZA 
NEW YORK NY 10112-0228 



p^/530524 



NOTIFICATION OF RECEIPT 
OF DEMAND 

(PCT Rule 61.1(b), first sentence 
and Administrative Instructions, Section 601) 





Date of mailing 

(day/mc^ear) | g J(JN 1898 


Applicant's or agent's file reference 
31075-PCT 


IMPORTANT NOTIFICATION 


International application No. 

PCT/US97/20024 


International filing date (day/month/year) 
04 NOV 97 


Priority date (dayfmonthfyear) 


Applicant 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF 
NEW YORK 



1. The applicant is hereby notified that this International Preliminary Examining Authority considers the following date as the 
date of receipt of the demand for international preliminary examination of the international application: 



02JUN1999 ( ba.otp.q^ 



This date of receipt is: 

actual date of receipt of the demand. 



late of receip 
[U| the a< 



□ 



the date on which the proper corrections to the demand were timely received. 



RECEIVED 
BAKER & BQTJS, LLP. 

99JUN22 PMI2:2I* 

TO 




j — j This date is AFTER the expiration of 19 months from the priority date. 

Attention: The election(s) made in the demand does (do) not have the effect of postponing the commencement of the 
national phase until 30 months from the priority date (or later in some Offices) (Article 39(1)). Therefore, the acts for 
entry into the national phase must be performed within 20 months from the priority date (or later in some Offices) 
(Article 22). 

For details, see Annex B to Form PCT/IB/301 sent by the International Bureau and Volume II of the PCT Applicant's 
Guide. 



□ 



This notification confirms the information given in person or by telephone on: 



ON SMOOCH KM 

i 



4. Only where paragraph 3 applies, a copy of this notification has been sent to the International Bureau. 



Name and mailing address of the IPEAAJS 
Assistant Commissioner for Patents 
Box PCT 

Washington, D.C 20231 Attn: IPEAAJS 

Facsimile No. 



Authorized officer 



PCT Operations - IAP0 Team 1 
Telephone ^03)305-3689 (703) 305-3230 RAX) 



Form PCT/IPEA/402 (July 1992) 



0 # 

PATENT COOPERATION TREATY 



From the 

INTERNATIONAL PRELIMINARY EXAMINING AUTHORITY 



To: 



HENRY TANG 
BAKER & BOTTS, LLP 
30 ROCKEFELLER PLAZA 
NEW YORK, NY 10112-0228 



PCT 



WRITTEN OPINION 

(PCT Rule 66) 



Date of Mailing 
(day I month f j ear) 



% 0 DEC 1999 



Applicant's or agent* s file reference 
31075-PCT 


REPLY DUE ... A 
within TWO months 

from the above date of mailing 


International application No. 
PCT/US97/20024 


International filing date (day 1 month Ijcar) 
04 NOVEMBER 1997 


Priority date (day/ monthly ear) 
NONE 


International Patent Classification (IPC) or both national classification and IPC 
IPC(6): G06K 9/00 and US CL: 382/115, 118, 165, 282, 283; 348/14, 19, 652 



Applicant 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK 



1. This written opinion is the 



first 



(first, etc.) drawn by this International Preliminary Examining Authority. 



2. This opinion contains indications relating to the following items: 



I 




II 


□ 


III 


□ 


IV 


□ 


V 




VI 


□ 


VII 


□ 


VIII 


□ 



Lack of unity of invention 

Reasoned statement under Rule 66.2(a)(ii) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 

Certain documents cited 



3. The applicant is hereby invited to reply to this opinion. 

When? See the time limit indicated above. The appli c ant may; boforo tho expiration of that time limit, r e qu e ot thifl 
Authority to grant an s xtonoion ,, o mm Rule 66.3(d) . 

How? 



By submitting a written reply, accompanied, where appropriate, by amendments, according to Rule 66.3. 
For the form and the language of the amendments, see Rules 66.8 and 66.9. 



Also 



For an additional opportunity to submit amendments, see Rule 66.4. 

For the examiner's obligation to consider amendments and/or arguments, see Rule 66.4 Aw. 
For an informal communication with the examiner, see Rule 66.6. 
If no reply is filed, the international preliminary examination report will be established on the basis of this opinion. 

4. The final date by which the international preliminary OAAn 

examination report must be established according to Rule 69.2 is: 04 MARCH ZOOQ . 



Name and mailing address of the I PEA/US 


AutliMzed f^ticer 


Commissioner of Patents and Trademark* 




Box PCT 


MCHRIS KELLEY 


Washington, D.C 20231 




Facsimile No. (703) 305-3230 


Telephone No. (703) 305-3900 



Form PCT/IPEA/408 (cover sheet) (January 1994)* 



0 



WRITTEN OPINION 


International application No. 
PCT/US97/20024 


L Basis of the opinion 



1. This opinion has been drawn on the basis of (Substitute sheets which have been famished to the receiving Office in response to an 
imitation under Article 14 are referred to in this opinion as "originally filed'. y. 

| x| the international application as originally filed. 

| x| the description, pages 1-24 , as originally filed. 



pages 
pages 



NONE 



NONE 



, filed with the demand. 
, filed with the letter of 



[U 



the claims, 



1-15 



NONE 



Nos. _ 

Nos. 

Nos> NONE 

Nos. 



NONE 



, as originally filed. 

, as amended under Article 19. 

, filed with the demand. 

, filed with the letter of 



| x| the drawings, sheets/fig 

sheets/fig NONE 



sheets/fig NONE 



, as originally filed. 

, filed with the demand. 

, filed with the letter of m 



2. The amendments have resulted in the cancellation of: 
| x| the description, pages ** QNE 



fx] the claims, Nos. NONE 
Q£J the drawings, sheets/Sg 



NONE 



3, | | This opinion has been established as if (some of) the amendments had not been made, since they have been 

considered to go beyond the disclosure as filed, as indicated in the Suppl e mental Box Additional observations below 
(Rule 70.2(c)). 

4. Additional observations, if necessary: 
NONE 



Form PCT/IPEA/408 (Box I) (January 1994)* 



9 # 





International application No. 


WRITTEN OPINION 






PCT/US97/20024 



V. Reasoned statement under Rule 66.2(a)(0) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 



1 . STATEMENT 
Novelty (N) 



Inventive Step (IS) 



Industrial Applicability (IA) 



2. CITATIONS AND EXPLANATIONS 

Claims 1-3, 7-8 and 10-15 lack novelty under PCT Article 33(2) as being anticipated by Burt. 

Regarding claims 1 and 15, Burt teaches a system and method for identifying face regions in a color image comprising: 

providing image data including data representative of chrominance for portions of said image (color tv camera 200a); 

comparing said chrominance data for each portion to values know to be skin tones, to thereby distinguish image 
portions representing skin tone colors from other regions (fleshtone detector 406 see col. 8, lines 47-54); and 

the shape comparing regions haveing skin tones to templates consistent with the shape of a human face to identify 
possible face regions (note templates in col. 9 have specific shapes as described in col. 10, lines 46-66). 

Regarding claims 2, 3 and 10-14, note that the database stores template as straight on and left and right which will 
meet the broad limitations in that straight on is rectangular with an aspect ration of 1 . Also note that the image portions have 
contigous pixels. 

Regarding claims 7 and 8 Burt teaches that moving images are analyzed which is equivalent to the claimed MPEG. 

Claims 4-6 and 9 lack an inventive step under PCT Article 33(3) as being obvious over Burt in view of Nakagawa et al. 

Regarding claims 4-6 and 9, although Burt fails to teach the specific spatial frequency requirements found in 
claims 4-6 and 9, Nakagawa does (see col.2, lines 59-63 and col.3, lines 1-11). since both systems are used to recognize 
the human face, it would have been obvious to combine the teachings to produce a more robust system. Further, since Burt 
is silent as to the specific spatial frequencies of the human face one of ordinary skill in the art would have been motivated to 
look to other teachings to fill in such details. 

(Continued on Supplemental Sheet.) 



Claims 4-6 and 9 _ YES 

Claims 1-3. 7-8 and 10-15 NO 

Claims none YES 

Claims 1^15 NO 

Claims hll YES 

Claims none NO 



Form PCT/IPEA/408 (Box V) (January 1994)* 



# 



WRITTEN OPINION 



International application No. 
PCT/US97/20024 



Supplemental Box 

(To be used when the space in any of the preceding boxes is not sufficient) 



Continuation of: Boxes I - VIII 



Sheet 10 



TIME LIMIT: 

The time limit set for response to a Written Opinion may not be extended. 37 CFR 1.484(d). Any response 
received after the expiration of the time limit set in the Written Opinion will not be considered in preparing the International 
Preliminary Examination Report. 



V. 2. REASONED STATEMENTS - CITATIONS AND EXPLANATIONS (Continued): 

NEW CITATIONS 

NONE 



Form PCT/I PEA/408 (Supplemental Box) (January 1994)* 



PATENT COOPERATION TREATY 



97/20024 



From the INTERNATIONAL BUREAU 



PCT 



NOTIFICATION OF RECEIPT OF 
RECORD COPY 

(PCT Rule 24.2(a)) 



To: 



TANG, Henry 
Baker & Botts, LLP 
30 Rockefeller Plaza 
New York, NY 10112-0228 
ETATS-UNIS D'AMERIQU 



JAN i 3 A II : | b 



Date of mailing (day/month/year) 

23 December 1997 (23.12.97) 


IMPORTANT NOTIFICATION 


Applicant's or agent's file refer*",*; 
31075-PCT 


International application No. 
PCT/US97/20024 



The applicant is hereby notified that the International Bureau has received the record copy of the international application as 
detailed below. 

Name(s) of the applicant(s) and State(s) for which they are applicants: 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK (for all designated 
States except US) 

CHANG, Shih-Fu et al (for US) 
International filing date 04 November 1997 (04.11.97) 

Priority date(s) claimed : 



22 December 1997 (22.12.97) 



Date of receipt of the record copy 
by the International Bureau 

List of designated Offices 
National :CA,US 



ATTENTION 

The applicant should carefully check the data appearing in this Notification. In case of any discrepancy between these data 
and the indications in the international application, the applicant should immediately inform the International Bureau. 

In addition, the applicant's attention is drawn to the information contained in the Annex, relating to: 



X 



time limits for entry into the national phase; 
| X | confirmation of precautionary designations; 
| | requirements regarding priority documents. 
A copy of this Notification is being sent to the receiving Office and to the International Searching Authority. 




The International Bureau of WIPO 


Authorized officer: 






34, chemin des Colombettes 


Aino 




1211 Geneva 20, Switzerland 






Facsimile No. (41-22) 740.14.35 


Telephone No. (41-22)338.83.38 





Form PCT/IB/301 (September 1996) 



001816536 





international application No. 

PCT/US97/20024 



ANNEX TO FORM PCT/IB/301 



INFORMATION ON TIME LIMITS FOR ENTERING THE NATIONAL PHASE 



The applicant is reminded that the "national phase" must be entered before each of the designated Offices indicated in the 
Notification of Receipt of Record Copy (Form PCT/IB/301) by paying national fees and furnishing translations, as prescribed by 
the applicable national laws. 

The time limit for performing these procedural acts is 20 MONTHS from the priority date or, for those designated States 
which the applicant elects in a demand for international preliminary examination or in a later election, 30 MONTHS from the 
priority date, provided that the election is made before the expiration of 19 months from the priority date. Some designated (or 
elected) Offices have fixed time limits which expire even later than 20 or 30 months from the priority date. In other Offices an 
extension of time or grace period, in some cases upon payment of an additional fee, is available. 

In addition to these procedural acts, the applicant may also have to comply with other special requirements applicable in 
certain Offices. It is the applicant's responsibility to ensure that the necessary steps to enter the national phase are taken in a 
timely fashion. Most designated Offices do not issue reminders to applicants in connection with the entry into the national 
phase. 

For detailed information about the procedural acts to be performed to enter the national phase before each designated 
Office, the applicable time limits and possible extensions of time or grace periods, and any other requirements, see the relevant 
Chapters of Volume II of the PCT Applicant's Guide. Information about the requirements for filing a demand for international 
preliminary examination is set out in Chapter IX of Volume I of the PCT Applicant's Guide. 

GR and ES became bound by PCT Chapter II on 7 September 1996 and 6 September 1997, respectively, and may, therefore, 
be elected in a demand or a later election filed on or after 7 September 1996 and 6 September 1997, respectively, regardless of 
the filing date of the international application. (See second paragraph above.) 

Note that only an applicant who is a national or resident of a PCT Contracting State which is bound by Chapter II has 
the right to file a demand for international preliminary examination. 



This notification lists only specific designations made under Rule 4.9(a) in the request. It is important to check that these 
designations are correct. Errors in designations can be corrected where precautionary designations have been made under 
Rule 4.9(b). The applicant is hereby reminded that any precautionary designations may be confirmed according to Rule 4.9(c) 
before the expiration of 1 5 months from the priority date. If it is not confirmed, it will automatically be regarded as withdrawn 
by the applicant. There will be no reminder and no invitation. Confirmation of a designation consists of the filing of a notice 
specifying the designated State concerned (with an indication of the kind of protection or treatment desired) and the payment 
of the designation and confirmation fees. Confirmation must reach the receiving Office within the 1 5-month time limit. 



For applicants who have not yet complied with the requirements regarding priority documents the following is recalled. 

Where the priority of an earlier national (i.e., national or regional) application is claimed, the applicant must submit a copy 
of the said national application, certified by the authority with which it was filed ("the priority document") to the receiving Office 
(which will transmit it to the international Bureau) or directly to the International Bureau, before the expiration of 16 months from 
the priority date (Rule 17.1). 

Where the priority document is issued by the receiving Office, the applicant may, instead of submitting the priority 
document, request the receiving Office to prepare and transmit the priority document to the International Bureau. Such 
request must be made before the expiration of the 1 6-month time limit. 

It is recalled that, where several priorities are claimed, the priority date to be considered for the purposes of computing the 
16-month time limit is the filing date of the earliest application whose priority is claimed. 

If the priority document concerned is not submitted to the International Bureau before the expiration of the 1 6-month time 
limit or if the request to the receiving Office to transmit the priority document has not been made (and the corresponding fee, if 
any, paid) before the expiration of this time limit, any designated State may disregard the priority claim. 



CONFIRMATION OF PRECAUTIONARY DESIGNATIONS 



REQUIREMENTS REGARDING PRIORITY DOCUMENTS 



Form PCT/IB/301 (Annex) (September 1997) 



001816536 
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PATENT COOPERATION TREATY BAKER &. BOTTS. LLP. 



From the INTERNATIONAL SEARCHING AUTHORITY 



To: HENRY TANG 

BAKER A BOTTS. LLP 
30 ROCKEFELLER PLAZA 
NEW YORK, NY 101 12-0228 



98 JUL 10 AM 10* 1*3 



NOTIFICATION OF TRANSMJTTAfc 
THE INTERNATIONAL SEARCH REPOR 
OR THE DECLARATION. 

(PCT Rule 44.1) 




Date of Mailing 
(day/month/year) 



08 JUL 1998 



Applicant's or agenfs file reference 
31075-PCT 



FOR FURTHER ACTION . See paragraphs 1 and 4 below 



International application No. 
PCT/US97/20024 



Internationa! filing date 
(day/month/year) 

04 NOVEMBER 1997 



Applicant 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK 



I | xj The applicant is hereby notified that the international search report has been established and is transmitted herewith. 
Filing of amendments and statement under Article 19: 

The applicant is entitled, if he so wishes, to amend the claims of the international application (see Rule 46): 

When? The time limit for filing such amendments is normally 2 months from the date of transmittal of the 
international search report; however, for more details, see the note s on the acconL PJUiyin a ^ * *j l ' j^ T "' 

Where? Directly to the International Bureau of WIPO ! OOOv^fE » *~ ^ 

34, chemin des Colombettes * Jf _ \ GCSft RY 

1211 Geneva 20, Switzerland i ir \ *X\ / a! t\J \ 1 
Facsimile No.: (41-22)740.14.35 



For more detailed instructions, sec the notes on the accompanying sheet 




□ 



The applicant is hereby notified that no international search report will be established' and that the declaration under 
Article 17(2X*) to tna * effect is transmitted herewith. 



3 j j With regard to the protest against payment of (an) additional fee(s) under Rule 40.2, the applicant is notified that 

□ the protest together with the decision thereon has been transmitted to the International Bureau together with the 
applicant's request to forward the texts of both the protest and the decision thereon to the designated Offices. 

| [ no decision has been made yet on the protest; the applicant will be notified as soon as a decision is made. 

4. Further action(s): The applicant is reminded of the following: 

Shortly after 18 months from the priority date, the international application will be published by the International Bureau. If 
the applicant wishes to avoid or postpone publication, a notice of withdrawal of the international application, or of the 
priority claim, must reach the International Bureau as provided in rules 90 bis 1 and -90 bis 3, respectively, before the 
completion of the technical preparations for international publication. 

Within 19 months from the priority date, a demand for international preliminary examination must be filed if the applicant 
wishes to postpone the entry into the national phase until 30 months from the priority date (in some Offices even later). 

Within 20 months from the priority date, the applicant must perform the prescribed acts for entry into the national phase before 
all designated Offices which have not been elected in the demand or in a later election within 19 months from the priority 
date, or could not be elected because they are not bound by Chapter II. 



Name and mailing address of the ISA/US 

Commissioner of Patents and Trademark* 
Box PCT 

Washington, D.C 20231 
Facsimile No. (703) 305-3230 



Authorized officer 
^CHRIS KELLEY 



telephone No. (703) 305-3900 



Form PCT/1SA/220 (January 1994)* 



(See notes on accompanying sheet) 



# 0 

PATENT COOPERATION TREATY 

PCT 

INTERNATIONAL SEARCH REPORT 
(PCT Article 18 and Rules 43 and 44) 



Applicant's or agenfs file reference 
31075-PCT 


FOR FURTHER see Notification of Transmittal of International Search Report 
ACTION (Form PCT/ISA/220) as well as, where applicable, item 5 


International application No. 
PCT/US97/20024 


International filing date (day /month/year) 
04 NOVEMBER 1997 


(Earliest) Priority Date 
NONE 


Applicant 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK 



This international search report has been prepared by this International Searching Authority and is transmitted to the applicant 
according to Article 18. A copy is being transmitted to the International Bureau. 

This international search report consists of a total of>^_ sheets. 

| X| It is also accompanied by a copy of each prior art document cited in this report. 



1. j j Certain claims were found unsearchable (See Box I). 

2. Unity of invention Is lacking (See Box II). 

3. f~ 1 The international application contains disclosure of 8 nucleotide and/or amino acid sequence listing and the 
L_J international search was carried out on the basis of the sequence listing 

filed with the international application. 

furnished by the applicant separately from the international application, 

but not accompanied by a statement to the effect that it did not include 



□ 
□ 



□ 



4. With regard to the title. 



□ 

□ 



matter going beyond the disclosure in the international application as filed, 
transcribed by this Authority. 

the text is approved as submitted by the applicant. 

the text has been established by this Authority to read as follows: 



5. With regard to the abstract, 

| | the text is approved as submitted by the applicant. 

[ x| ,ne text nas been established, according to Rule 38.2(b), by this Authority as it appears . 
in Box III. The applicant may, within one month from the date of mailing of this 
international search report, submit comments to this Authority. 

6. The figure of the drawings to be published with the abstract is: 

Figure No. J Q as suggested by the applicnn,. r-J NoBe ofthe figufw. 

| X| because the applicant failed to suggest a figure. 

| 1 because this figure better characterizes the invention. 



Form PCT/ISA/2I0 (first sheetX-luly 1992)* 



# 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US97/20024 



Box III TEXT OF THE ABSTRACT (Continuation of item 5 of the first sheet) 



A highly efficient method is disclosed for rapidly detecting human face regions 
in color images and video frames. The method consists of three stages, where 
chrominace (stage 1), shape (stage 2) and spatial frequency information (stage 3) 
are used respectively. In the first stage, the chrominance data for incremental 
image portions is compared to skin tone data to identify skin tone image portions. 
In the second stage regions of contiguous skin tone image portions are compared to 
templates corresponding to the shape of faces in images. In the optional third 
stage, the spatial frequency characteristics of luminance data in the selected 
possible face region is compared to at least one threshold value to eliminate regions 
that do not include spatial frequency characteristics corresponding to those of a face 
region. 



Form PCT/ISA/210 (continuation of first sheet(2)XJuly 1992)* 



INTERNATIONAL SEARCH REPORT 



Internationa) application No. 
PCT/US97/20024 



A. CLASSIFICATION OF SUBJECT MATTER 
IPC(6) :G06K 9/00 

US CL :382/115. 118, 165, 282. 283; 348/14, 19, 652 
According to International Patent Classification (IPC) or to both national classification and IPC 


R FIELDS SEARCHED 


Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 382/115,118,165,282, 283:348/14,19,652 


Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 


Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 


C. DOCUMENTS CONSIDERED TO BE RELEVANT 


Category* 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


X 
Y 


US 5,063,603 A (BURT) 05 November 1991, see col. 8, lines 44-54 
and col. 9, lines 3-26 also see figures 3 and 4. 


1.3, 7-8, 10-15 
4-6 and 9 


X 
Y 


US 5,479,529 A (NAKAGAWA et al) 26 December 1995, see col.2, 
lines 59-63 and col. 3, lines 1-11. 


1-3, 7-8, 10-15 
4-6 and 9 


A 


US 5,550,928 A (LU et al) 27 August 1996, see abstract 


1 and 15 


| Further documents are listed in the continuation of Box C. | | See patent family annex. 


* Special categories of cited documents: 

"A" document defining the general state of the art which is not considered 
to be of particular relevance 

"E" earlier document published on or after the international filing date 

"L" document which may throw doubts on priority claim(s) or which is 
cited to establish the publication date of another citation or other 
special reason (as specified) 

"0" document referring to an oral disclosure, use. exhibition or other 
means 

*P" document published prior to the international filing date but later than 
the priority date claimed 


"T" later document published after the international filing date or priority 
date and not in conflict with the application but cited to understand 
the principle or theory underlying the invention 

"X" document of particular relevance; the claimed invention cannot be 
considered novel or cannot be considered to involve an inventive step 
when the document is taken alone 

"Y" document of particular relevance; the claimed invention cannot be 
considered to involve an inventive step when the document is 
combined with one or more other such documents, such combination 
being obvious to a person skilled in the art 

"Sl* document member of die same patent family 


Date of the actual completion of the international search 
02 FEBRUARY 1998 


Date of mailing of the international search report 

,08 JUL W 


Name and mailing address of the ISA/US 
Commissioner of Patents and Trademarks 
Box PCT 

Washington, D.C 20231 
Facsimile No. (703) 305-3230 


Authorized officer v 

CHRIS KELLEY \J$^) 
Jelephone No. (703) 305-3900 



Form PCT/ISA/2I0 (second sheetX-My 1992)* 



A * 



NOTES TO FORM PCT/ISA/220 (continued) 



The following examples illustrate the manner in which amendments must be explained in the 
accompanying letter: 



1. [Where originally there were 48 claims and after amendment of some claims there are # 3l]: 
"Claims 1 to 29, 31, 32, 34, 35, 37 to 48 replaced by amended claims bearing the same numbers; 
claims 30, 33 and 36 unchanged; new claims 49 to 51 added.** 

2. [Where originally there were 15 claims and after amendment of all claims there are 11]: 
"Claims 1 to 15 replaced by amended claims 1 to 11/* 

3. [Where originally there were 14 claims and the amendments consist in cancelling some claims and in adding 
new claims]: 

-a aims 1 to 6 and 14 unchanged; claims 7 to 13 cancelled; new claims 15, 16 and 17 added." or 
"Claims 7 to 13 cancelled; new claims 15, 16 and 17 added; all other claims unchanged.** 

4. [Where various lands of amendments are made]: 

^Claims 1-10 unchanged^ claims 11 to 13, 18 and 19 cancelled; claims 14, 15 and 16 replaced by amended 
claim 14; claim 17 subdivided into amended claims 15, 16 and 17; new claims 20 and 21 added.** 



"Statement under Article 19(1)** (Rule 46.4) 

The amendments may be accompanied by a statement explaining the amendments and indicating any impact 
that such amendments might have on the description and the drawings (which cannot be amended under 
Article 19(1)). 

The statement will be published with the international application and the amended claims. 

The statement should be brief, it should not exceed 500 words if in English or if translated into English/ 

It should not be confounded with and does not replace the letter indicating the differences between the claims 
as filed and as amended. It must be filed on a separate sheet and must oe identified as such by a heading, 
preferably by using the words "Statement under Article 19(1)*** 

It should not contain any disparaging comments on the international search report or the relevance of citations 
contained in that report Reference to citations, relevant to a given claim, contained in the international search 
report may be made only in connection with an amendment of that claim. 



In what language ? 

The amendments must be made in the language in which the international application is published. The letter 
and an v statement accompanying the amendments must be in the same langua ge as the international application 
if that language is English or French; otherwise, it must be in English or French, at the choice of the applicant. 

Consequence if a demand for in tc national preliminary examination baa already been UlecT? 

If, at the time of filing any amendments under Article 19, a demand for international preliminary examination 
has already been submitted, the applicant must preferably, at the same time of filing the amendments with the 
International Bureau, also file a copy of such amendments with the International Preliminary Examining 
Authority (see Rule 62.2(a), first sentence). 

Consequence with regard to translation of the international application for entry into the national phase ?. 

The applicant's attention is drawn to the fact that, where upon entry into the national phase, a translation of the 
claims as amended under Article 19 may have to be furnished to the designated/elected Offices, instead of, or 
in addition to, the translation of the claims as filed. 

For further details on the requirements of each designated/elected Office, see Volume II of the PCT Applicant's 
Guide. 
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COMMUNICATION OF THE INTERNATIONAL 
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(PCT Rule 47.1(c), first sentence) 



Date of mailing (day/month/year) 
14 May 1999(14.05.99) 
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TANG, Henry BAKER & BOTTS. LLP 

Baker & Botts, LLP 

30 Rockefeller Plaza 99 HAY 25 AH I h 5 1 
New York, NY 10112-0228 
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Applicant's or agent's file reference 
31075-PCT 


IMPORTANT NOTICE 


International application No. 
PCT/US97/20024 


International filing date (day/month/year) 

04 November 1997 (04.11.97) 


Priority date (day/month/yearj 


Applicant 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK et al 



1. Notice is hereby given that the International Bureau has communicated, as provided in Article 20, the international application 
to the following designated Offices on the date indicated above as the date of mailing of this Notice: 

US 

In accordance with Rule 47.1 (c), third sentence, those Offices will accept the present Notice as conclusive evidence that 
the communication of the international application has duly taken place on the date of mailing indicated above and no copy 
of the international application is required to be furnished by the applicant to the designated Office(s). 

2. The following designated Offices have waived the requirement for such a communication at this time: 

CA ~ " 

The communication will be made to those Offices only upon their request. Furthermore, those Offices do not require the 
applicant to furnish a copy of the international application (Rule 49.1 (a-bis)). 




3. Enclosed with this Notice is a cop^y^fthe international application as published by the International Bureau on 
14 May 1999 (14.05.99) under No. WO 99/23600 

REMINDER REGARDING CHAPTER II (Article 31(2)(a) and Rule 54.2) 

If the applicant wishes to postpone entry into the national phase until 30 months (or later in some Offices) from the priority 
date, a demand for international preliminary examination must be filed with the competent International Preliminary 
Examining Authority before the expiration of 1 9 months from the priority date. 

It is the applicant's sole responsibility to monitor the 19-month time limit. 

Note that only an applicant who is a national or resident of a PCT Contracting State which is bound by Chapter II has the 
right to file a demand for international preliminary examination. 

REMINDER REGARDING ENTRY INTO THE NATIONAL PHASE (Article 22 or 39(1)) 

If the applicant wishes to proceed with the international application in the national phase, he must, within 20 months 
or 30 months, or later in some Offices, perform the acts referred to therein before each designated or elected Office. 

For further important information on the time limits and acts to be performed for entering the national phase, see the 
Annex to Form PCT/IB/301 (Notification of Receipt of Record Copy) and Volume II of the PCT Applicant's Guide. 





The International Bureau of WIPO 
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1211 Geneva 20, Switzerland 
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Telephone No. (41 -22) 338.83.38 ^ 
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NOTIFICATION OF TRANSMITTAL OF' 
INTERNATIONAL PRELIMINARY 
EXAMINATION REPORT 



(PCT Rule 71.1) 






fday/mo^Sear) Q 5 /\PR 2000 


Applicant's or agent's file reference 
31075-PCT 


IMPORTANT NOTIFICATION 


International application No. 
PCT/US97/20024 


International filing date (day/month/year) 
04 NOVEMBER 1997 


Priority Date (day/month/year) 
NONE 


Applicant 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK 



1 . The applicant is hereby notified that this International Preliminary Examining Authority transmits herewith the 
international preliminary examination report and its annexes, if any, established on the international application. 

2. A copy of the report and its annexes, if any, is being transmitted to the International Bureau for communication 
to all the elected Offices. 

3. Where required by any of the elected Offices, the International Bureau will prepare an English translation of 
the report (but not of any annexes) and will transmit such translation to those Offices. 

4. REMINDER 

The applicant must enter the national phase before each elected Office by performing certain acts (filing 
translations and paying national fees) within 30 months from the priority date (or later in some Offices)( Article 
39(l))(see also the reminder sent by the International Bureau with Form PCT/IB/301). 

Where a translation of the international application must be furnished to an elected Office, that translation must 
contain a translation of any annexes to the international preliminary examination report. It is the applicant's 
responsibility to prepare and furnish such translation directly to each elected Office concerned. 

For further details on the applicable time limits and requirements of the elected Offices, see Volume II of the 
PCT Applicant's Guide. 





Name and mailing address of the IPEA/US 

Commissioner of Patents and Trademarks 
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Washington, D.C. 20231 
Facsimile No. (703) 305-3230 


Authorized officer ^ 

BHAVESH MEHTA ^rfj 
Telephone No. (703) 305-3900 
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PCT 

INTERNATIONAL PRELIMINARY EXAMINATION REPORT 
(PCT Article 36 and Rule 70) 



Applicant's or agent's file reference 
31075-PCT 


FOR FURTHER ACTION See Notification of Transmittal of International 

Preliminary Examination Report (Form PCT/IPEA/416) 


International application No. 
PCT/US97/20024 


International filing date (day/month/year) Priority date (day/month/year) 
04 NOVEMBER 1997 NONE 


International Patent Classification (IPC) or national classification and IPC 
IPC(6): G06K 9/00 and US CI.: 382/115, 118. 165, 282, 283; 348/14, 19, 652 


Applicant 

THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK 



This international preliminary examination report has been prepared by this International Preliminary 
Examining Authority and is transmitted to the applicant according to Article 36. 



2. 



This REPORT consists of a total 

□ 



sheets. 



This report is also accompanied by ANNEXES, i.e., sheets of the description, claims and/or drawings which have 
been amended and are the basis for this report and/or sheets containing rectifications made before this Authority, 
(see Rule 70. 16 and Section 607 of the Adiriinistrative Instructions under the PCT). 

0- 



These annexes consist of a total of 



sheets. 



This report contains indications relating to the following items: 
Basis of the report 
Priority 

Non-establishment of report with regard to novelty, inventive step or industrial applicability 
Lack of unity of invention 

Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 



I 


LI 


II 


□ 


III 


□ 


IV 


□ 


V 




VI 


□ 


VII 


□ 


VIII 


□ 



Date of submission of the demand 
02 JUNE 1999 


Date of completion of this report 
04 MARCH 2000 


Name and mailing address of the IPEA/US 

Commissioner of Patents and Trademarks 
Box PCT 

Washington, D.C. 20231 
Facsimile No. (703) 305-3230 


Authorized officer 

BHAVESH MEHTA ^QrfvL ^ jj^ 
Telephone No. (703) 305-3900 



Form PCT/IPEA/409 (cover sheet) (January 1994)* 



INTERNATIONAL PRELIMINARY EXAMINATION REPORT 



International application No. 
PCT/US97/20024 



I. Basis of the report 



1 . This report has been drawn on the basis of (Substitute sheets which have been furnished to the receiving Office in response to an invitation 
under Article 14 are referred to in this report as "originally filed" and are not annexed to the report since they do not contain 



XI the international application as originally filed. 



fx] the description, pages 1-24 



pages NONE 



| x| the claims, 



pages 
pages 

Nos. 
Nos. 



NONE 



as originally filed, 
filed with the demand, 
filed with the letter of 
filed with the letter of 



1-15 



NONE 



Nos. NONE 
Nos. NONE 
Nos. 



, as originally filed. 

, as amended under Article 19. 

, filed with the demand. 

, filed with the letter of 

, filed with the letter of 



Q^J the drawings, sheets/6g 1-11 



sheets/fig NONE 



sheets/fig NONE 
sheets/fig 



, as originally filed. 
, filed with the demand. 
, filed with the letter of 
, filed with the letter of 



2. Hie amendments have resulted in the cancellation of: 
|"x] the description, 
|~xj the claims, 
[ x| the drawings, 

3 . I I This report has been established as if (some of) the amendments had not been made, since they have been considered 
— to go beyond the disclosure as filed, as indicated in the Supplemental Box Additional observations below (Rule 

70.2(c)). 

4. Additional observations, if necessary: 
NONE 



pages NONE 
Nos. NONE 
sheets^ig NONE 



Form PCT/IPEA/409 (Box I) (January 1994)* 



INTERNATIONAL PRELIMINARY EXAMINATION REPORT 



International application No. 
PCT/US97/20024 



V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 



1. STATEMENT 



Novelty (N) Claims 4-6 and 9 YES 

Claims 1-3, 7-8 and 10-15 NO 

Inventive Step (IS) Claims none YES 

Claims M5 NO 

Industrial Applicability (IA) Claims ^ YES 

Claims none NO 



2. CITATIONS AND EXPLANATIONS 

Claims l-3 t 7-8 and 10-15 lack novelty under PCT Article 33(2) as being anticipated by Burt. 

Regarding claims 1 and 15, Burt teaches a system and method for identifying face regions in a color image comprising: 

providing image data including data representative of chrominance for portions of said image (color tv camera 200a); 

comparing said chrominance data for each portion to values know to be skin tones, to thereby distinguish image 
portions representing skin tone colors from other regions (fleshtone detector 406 see col.8 f lines 47-54); and 

the shape comparing regions haveing skin tones to templates consistent with the shape of a human face to identify 
possible face regions (note templates in col. 9 have specific shapes as described in col. 10, lines 46-66). 

Regarding claims 2, 3 and 10-14, note that the database stores template as straight on and left and right which will 
meet the broad limitations in that straight on is rectangular with an aspect ration of 1. Also note that the image portions have 
contigous pixels. 

Regarding claims 7 and 8 Burt teaches that moving images are analyzed which is equivalent to the claimed MPEG. 

Claims 4-6 and 9 lack an inventive step under PCT Article 33(3) as being obvious over Burt in view of Nakagawa et al. 

Regarding claims 4-6 and 9, although Burt fails to teach the specific spatial frequency requirements found in 
claims 4-6 and 9, Nakagawa does (see col.2, lines 59-63 and col.3, lines 1-11). since both systems are used to recognize 
the human face, it would have been obvious to combine the teachings to produce a more robust system. Further, since Burt 
is silent as to the specific spatial frequencies of the human face one of ordinary skill in the art would have been motivated to 
look to other teachings to fill in such details. 

(Continued on Supplemental Sheet.) 
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INTERNATIONAL PRELIMINARY EXAMINATION REPORT 



International application No. 
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Supplemental Box 

(To be used when the space in any of the preceding boxes is not sufficient) 



Continuation of: Boxes I - VIII Sheet 10 
V. 2. REASONED STATEMENTS - CITATIONS AND EXPLANATIONS (Continued): 
NEW CITATIONS 



NONE 
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